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(54) TiUc: METHODS AND SYST1BMS FOR PROVroiNG HUMAN/COMPUTER INTERFACES 
(57) Abstract 

The present invention 
teaches a variety of methods 
and systems for providing 
computei/human interfaces. 
AccOTding to one method, the 
user interfaces with an etectronic 
device such as a computer 
system by engaging a sensor 
with desired regions of an 
encoded physical medium. The 
encoded i^ysical medhmi is 
preferably dioscn to provide 
mbiitive meaning to tlie user, and 
is thus an Improved metaphor 

for- infa^-Aran^^ltoti^. mmpnfPH- 

system. Suitable examples- of 
the encoded physical medium 
include a datah41nlud boolc, 
magazine, globe, or articles 
of clothing. Some or all of 
the selected regions have had 
ceitain information encoded 
therein. Information suitable for 
tnlerfacing and controlling the 
computer system. When the user 
engages the sensor with a region 

having certain encoded information, the certain encoded information is interpreted and an appropriate action taken. For example, me 
sensor or the computer system may provide suitable feedback to the user. The encoded physical medium may have text and/or graphic 
illustrations that draw the user in or provide meaningful clues or instructions pcrtuips related to the encoded faiformation. One scheme for 
storing the certain encoded data is a spectral encoding scheme. In a preferred embodiment, the spectral encoding scheme uses red, green, 
Wcue (RGB). The content is encoded according to the intcnsiUci of die RGB colors within the hot spot. In another embodiment, a marker 
color is inserted into the hot spot to indicate that content is encoded therein. 




m 

CO 



O 

o 



FOR THE PURPOSES OF iNFORMATlON ONLY 



Cod« used to identify States party to the PCT on the front pages of pamphlets publishing intcmatioaal applications under the PCT. 







ES 


AM 


Anaeak 


n 


AT 


Antria 


FR 


AU 


AMnralU 


GA 


A£ 


Axeybtijsa 


CB 


BA 


BocaU uuf HerxccovMu 


GB 


BB 


Bait»«Soi 


GH 


BE 




CH 


BP 


Dojlnit Faso 


OR 


BG 




in/ 


BJ 


Benin 


IE 


BR 


Bfui1 


tL 


BY 


Belmu 


IS 


CA 


Canada 


IT 


CF 


Centra) Ahicin RcpoUic 


JP 


CC 


CoDtO 


KE 


CH 


Switzerland 


KG 


CI 


C6te dlvotfc 


KP 


CM 


Clin croon 




ON 


China 


KK 


CU 


Cbba 


KZ 


CZ 


Ciecfa Republic 


LC 


OE 


Geimaax 


LI 


DK 


DcnmarV 


UC 


EE 


EsoaU 


LR 



Sptio 
Fmltnd 
ftmcc 
Oaboa 

lMi(«d KiQcdotn 

Ooorc'ia 

Ohaaa 

Ontaea 

Greece 

Ilmsary 

Ireland 

farad 

Iceland 

fcaly 

lapan 

KcBTa 

DemoCTHk People*! 
RefnUic of Kocra 
RefnibTic or Korea 
Kazjtkstan 
Saint Locta 
Liocfalenstein 
Sri Lanka 
Libcru 



LS 


t^eaodio 


SI 


Skrveala 


LT 


rJthuanU 


SK 


SlovtkU 


LU 


LBxeoiboorj 


SN 




LV 


Ltfvla 


SZ 


Svazflaod 


MC 


Mooaoo 


TD 


a>ad 


MD 


RcpuUtcoTMoUovi 


TC 




MG 


Madatascar 


TJ 


T^jOihtaa 


MK 


The farmer Ynfostav 


TM 


T\rtB>enhlin 




RcpoUic of Maoedooia 


TR 




ML 


Mafi 


TT 


Itiaidad and Tbfaaco 


MN 


MoogoKa 


UA 


Ukrtjae 


MR 


MaurilaaU 


VG 


Uganda 


MW 


MaUwi 


US 


United Stales of Ante 


MX 




UZ 


UxbcfcBUB 


KE 


Niter 


VN 


VktNam 


HL 


Necheriaadt 


vu 


Yvfoalrrb 


NO 


Norway 


ZW 


Ztaibabwe 


NZ 


New Zealand 






PL 


Poland 






PT 


PorTU{aJ 






RO 


Romania 






RU 


Rauian Federacioa 






SD 


Sudan 






SB 


Sweden 






SC 


Siattpore 







wo 99/18487 



PCT/US98/20661 



METHODS AND SYSTEMS FOR PROVIDING HUMAN/COMPUTER 

INTERFACES 



5 Background of the Invention 

This invention relates generally to computer interfaces. More 
specifically, the present invention discloses a variety of computer interfaces 
using encoded lAysical ^mediumsvwherein^^^^^^^^^^^ region may include a 

10 marker indicating that information is encoded therein. The present invention 
also teaches data-linked physical mediums that provide users intuitive access to 
multimedia information that may be stored remotely. 

People are constantly interacting with computerized systems, from the 
trivial (eg., the computerized toaster or the remote control television) to the 
15 exceedingly complex {e.g., telecomm unications systems and the internet). An 
advantage of computerization is that such systems provide flexibility and power 
to their users. However, the price that must be paid for this power and 
flexibiUty is, typically, an increase in the difficulty of the human/machine 
interface. 

20 A fundamental reason for this problem is that computers operate on 

principles based on the abstract concepts of mathematics and logic, while 
humans tend to think in a more spatial manner. Often people are more 
comfortable with physical, three-dimensional objects than they are with the 
abstractions of the conq>uter world. In short, the power and flexibility provided 

25 by the computer and related electronic technology are inherently limited by the 
abiUty of the human user to control these devices. Since people do not think 
like computers, metaphors are adopted to permit people to effectively 
communicate with computers. In general, better metaphors permit more 
efficient and "medium in d e pend e nt comniunit:ations between people and 

30 computers. The^better;metaphor will provide; the us a natural and intuitive 
interface with the computer without sacrificing the computer's potential. 

There are^ of course, a number of computer interfaces which allow users, 
with varying degrees of comfort and ease, to interact with computers. For 

. 1 - 
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example, keyboards, computer mice, joysticks, etc. allow users to physically 
manipulate a three-dimensional object to create an input into a computer 
system. However, these computer interfaces are quite artificial in nanire, and 
tend to require a substantial investment in training to be used efficiently. 

5 Progress has been made in improving the computer interface with the 

graphical user interface (GUI). With a GUI, icons that represent physical 
objects are displayed on a computer screen. For example, a document file may 
look like a page of a document, a directory file might look like a file folder, and 
an icon of a trasb can .niay :be 4ised .for disposing'^ b and files. In 

10 other words, GUIs use "metaphors" where a graphical icon represents a .physical 
object familiar to users. This makes GUIs easier for most people to use. GUIs 
were pioneered at such places as Xerox PARC of Palo Alto, CaHfomia and 
Apple Computer, Inc. of Cupertino, California. The GUI is also often 
commonly used with UNIX™ based systems, and is rapidly becoming a 
standard in the PC/MS-DOS world with the Windows™ operating system 
provided by Microsoft Corporation of Redmond, Washington. 

While GUIs are a major advance in computer interfaces, they nonetheless 
present a user with a learning curve due to their still limited metaphor. In other 
words, an icon can only represent a physical object; it is not itself a physical 

20 object. It would be ideal if the computer interface was embodied in a physical 
medium which could convey a familiar meaning, one perhaps relevant to the 
task at hand. While progress has been made towards achieving such a goal, 
many roadblocks yet remain. For example, assuming that for a given 
application one has selected a physical medium for use as a computer interface, 

25 the information necessary to support the computer interface must still be 
encoded within the physical medium. Additionally, techniques must be 
developed for linking such interfaces with the vast wealth of information 
available fi-om remote sources using computer networks like the Internet. 

Redford et al/s U.S. Patent Serial No. 5,634,265, entitled "PRINTED 
30 PUBLICATION REMOTE CONTROL FOR ACCESSING INTERACTIVE 
MEDIA," filed My 1, 1994, describes one rudimentary mechanism for 
encoding information within a physical medium. Redford describes the use of a 
printed publication such as a book being constructed to include a storage media, 
a data button, and remote control circuitry. The button is physically attached to 
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the pnnted publication and when activated by a user, data from the storage 
media can mittat^0€Sff at the pnnted ^^^Kljcatipn and the remote 

control can minsmit a control message to a remote computer system which in 
turn performs some desu^'^eitfion." ^ 

While strides have been made in attempting to improve computer 
interfaces, there is still progress to be made in this field. Ultimately, the 
interface itself should disappear from the conscious thought of uscts so that they 
can intuitively accomplish their goals without concern to the mechanics of the 
interface or thc.underlying operatioa.of the computerized system. 
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Summary of the TnYonHnn 

The present invention improves the human/computer interface by 
providing a method for interfacing via an encoded physical medium having a 
region wherein information has been encoded. The interface method includes 
measunng mformation presem in a first region of the encoded physical medium 
and then detennining whether the measured inforaiation contains a marker 
indicating that certain information has been encoded therein. According to one 
embodiment, th^jinarker-is^capablevof^geherating light within a particular range 
of electromagnetic wavelengths, either by reflection or through luminescence 
When the marker is reflective, the sensor typically includes a light emitting 
element and a sensing element. However, when the marker and the encoded 
region are luminescent, the sensor need only include a sensing element. 

In related embodiments of the present invemion. the information may be 
encoded according to a spectral encoding scheme, a bar code scheme or a 
combination thereof. The marker may be infrared ink applied over the certain 
encoded information, regardless of how the certain information is encoded. 

The present invention also teaches that when it is determined that the 
marker is present in the first region, the certain encoded information is 
translated mto certain decoded information including a function to be performed 
by the computer system. The function to be performed by the computer system 
may include, among otiicr things, providing visual, audio, and/or tactile 
feedback. The certain decoded information could also include a uniform 
resource locator (URL) and the function may involve the computer system 
accessing and/or displaying an Internet web page to which the URL directs. 

The present invention further teaches maintaining a database tracking tiie 
results of the user engaging the sensor with a plurality of regions, including the 
determination of null meaning region, /.e.. regions that do not contain a marker 
The database cpuI4,then be=used later to determine whether a specific condition 
such as collection of a fixed number of clues or data points) has been satisfied 
In turn, a specified action could be performed by the sensor of the computer 
system. 
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The present invention further improves upon the human/cx)mputer 
interface by teaching a method for generating an encoded physical medium 
having a region with encoded content. The method requires receiving content 
that is to be encoded into a desired location on the encoded physical medium, 

5 encoding the content according to a particular encoding scheme suitable for 
application onto the encoded physical medium, and inserting the encoded 
content together with a marker into a corresponding desired location within a 
representation of the encoded physical medium. The marker indicates that the 
content is encoded within the corresponding desired location, thereby enabling a 

10 subsequently engaged ^sensornocrdetenmnev^^ of the content Once 

the representation is created, the present invention further teaches that the 
encoded physical mediuni may be generated from the representation. 

According to a related aspect of the present invention, the step of 
encoding the content together with the marker includes generating a binary 

15 number that represents the content and encoding the binary number that 
represents the content according to a spectral encoding scheme. In somerrelated 
embodiments, the marker represents ink that reflects light from within a 
particular range of electromagnetic Wavelengths. Of course, the present 
invention also teaches that text and graphics may be designed within the 

20 representation of the encoded physical medium. Additionally, the encoded 
physical medium may be created directly, rather than first creating a 
representation using a computer system or other such tool. 

One separate embodiment of the present invention teaches a computer 
interface between a user and a computer system using an encoded physical 

25 mediiun. The encoded physical medium is suitable for having at least one 
region wherein information has been encoded The computer interface includes 
a sensor operable for measuring inforaiation present on the encoded physical 
mediimi, and a first device coupled to the sensor and responsive to determine 
whether information measm-ed by the sensor includes a marker indicating that 

30 certain encoded information is present in the measured mformation. In airelated 
embodiment, the computer interface includes a second device responsive to the 
first device such that when the first device determines the presence of the 
marker, the second device is operable to decode the certain encoded information 
present in the measured information. In yet another related embodiment, the 
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computer interface also has a transmitter device operable to transmit the certain 
aecoded mformation to the computer system. 

In still another related embodiment, the marker is operable to generate 
light from within a particular range of electromagnetic wavelengths In this 
embodmient. the sensor has a sensing element responsive to the particular ranee 
of electromagnetic wavelengths. By generate light, it is meant that the marker 
can either reflect and/or emit light. 

In some,.embodiments^ the -sensor ^has^^^ opaque shroud covering the 
sensmg element to protect it from, ambient light. In other embodiments the 
sensor mcludes filter circuitry to eliminate noise due to the ambient light. ' 

One other separate embodiment of the present invention teaches an 
encoded physical medium. The encoded physical medium is suitable for use in 
mterfacmg a user and a computer system and has a region wherein certain 
mformation is encoded. The certain encoded information includes a marker 
mdicatmg that the certain encoded information is encoded in the first region 
me certain encoded information includes data suitable for interpreting into 
computer readable data. The encoded physical medimn may take on a variety of 
forms suchas an article of apparel, packaging material, a book or magazine, and 
a globe. The certain encoded information may be encoded according to a bar 
code or spectral encoding scheme, the spectral encoding scheme including 
encoding colors red. green, and blue, and possibly some colors chosen from the 
inlrarea color range. 

Still another separate embodiment of the present invention teaches an 
clectromc data linked physical medium suitable for linking a physical medium 
with video and audio data stored on multimedia networked computers 
Typically, the data linked medium includes a physical medium having at least 
one hot spot encoded with linking data enabling the data linked physical 
medmmao access remote .data, a sensor operable to measure and decode the 
linking data, an4a transmitter operable to transmit the linking data to a remote 
computer system The remote computer system is responsive to the linking data 
to retneve the remote data and present it to a user of the data linked physical 
medium. -Hius die user of the data linked physical medimn is provided a 
mechanism for linking to and accessing remote data. 
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The present invention therefore provides a more intuitive and richer 
metaphor for the interaction between humans and computerized systems. These 
and other advantages of the present invention will become apparent upon 
reading the following detailed descriptions and studying the various figures of 
the drawings. 
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Brief Description nftly ^ DrawinpQ 



Figure 1 is a diagrammatic illustration of a computer interface in 
accordance with one embodiment of the present invention. 

5 2 is a flow chart illustrating one method for providing an interface 

between a user and a computer system in accordance with one aspect of the 
present invention. »- uic 

Figure 3 is a flow chart illustrating one suitable method for providing a 
user an encoded physical medium in accordance with another aspect of the 
10 present invention. F^i oi me 

Figure 4 is a diagrammatic illustration of a hot spot in accordance with 
one embodiment of the present invention. 

Figure 5 illustrates a sensor responsive to a first spectral encoding scheme 
in accordance with yet another embodiment of the present invention. 

15 Figure 6 is a flow chart illustrating one suitable method for measurinp 

mformation encoded in a hot spot. 

Figure 7 is a diagrammatic illustration of a hot spot representation in 
accordance with one embodiment of the present invention. 

Figure 8 is a diagrammatic iUustration of a hot spot generated from the 
20 hot spot representation of Figure 7. 

Figure 9 is a flow chart illustrating one suitable method for perfomiing 
step 204 of Figure 3 in accordance wifli still another aspect of the present 
invention. ^ 

Figure 10 is a diagrammatic illustration of a first data linked book 
25 embodiment of the present invention. 

Figure 11 is a diagrammatic illustration of a data linked globe 
embodiment of the present invention. 
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Detailed Description of the Preferred Embodiments 

With reference to Figure 1, a computer interface 10 in accordance with 
one embodiment of the present invention will now be described. The interface 
10 includes a sensor 12 and an encoded physical medium 30. As will be 
5 apparent, the computer interface 10 provides an intuitive mechanism for a user 
to interface with and control an electronic device such as a computer system 40 
(also illustrated in Figure 1). 

The encoded< phy5ical '^medium>30 has at least one region 32 wherein 
information has been encoded. The content of the region 32 may be encoded 

10 according to a well known content encoding scheme such as a bar code scheme. 
The present invention also teaches a variety of new encoding schemes. For 
example, a content encoding scheme contemplated by the present invention is a 
bar code pri^^c^ij^J^ Sij^^^a^fea^d^pji 
be apparent t6^t^^ps^g^^t^i^^s^y^^jyJ^ Alternatively, the cratent of 

15 the regioh'Sll'riday be encoded according to a spectral encoding scheme. Several 
specific examples of suitable spectral encoding schemes are described below 
with reference to Figures 4-8. The encoded physical medium 30 may also 
include a document identification (ID) hotspot 33, similar to the region 32. The 
content encoded within the document ID hotspot 33 will, however, be special in 

20 that it provides an indication of the identity of the particular encoded physical 
medium 30. 

In certain embodiments, encoded regions such as the region 32 further 
include a marker 34 indicating that certain encoded information is present in the 
region 32. By way of example, in one spectral encoding scheme, the desired 

25 content for the region 32 is represented according to different visible and 
inftared inks (reflective and/or photolimiinesccnt) applied to the region 32. The 
maricer 34 is represented by yet another infrared ink similarly applied to the 
region 34. In this example, the user would not see the marker 34, but may or 
may not see a' visual rcpresentation-of the content encoded in the region 32. 

30 Throughout the specification, markers, hotspots, regions, inks, etc., are often 
described as being able to generate light. Being able to " generate lighf' is 
defined herein as including at least one of the ability to reflect or emit light. 
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The encoded physical medium 30 may take any suitable form. By way of 
example, the encoded physical medium 30 may be a page from a physical book 
or magazine, an article of clothing such as a T-shirt, a globe, consumer product 
packaging, etc. Such encoded physical mediums may have been marked and 
encoded with data for the specific purpose of providing the interface of the 
present mvention. Alternatively, the encoded physical medium 30 may simply 
be Items selected from a user's surroundings, the encoded information arising 
randomly or imintentionally (at leastwith relation to the user's application). In 
another emboiimentiHthe encodedicontent arises randomly or unintentionally 
but a marker- 34ns applied intentionally. Some representative examples of 
encoded physical mediums are described below with reference to Figures 10-1 1, 

The sensor 12 includes a sensing element 13. a decoder 14, a transceiver 
16, an on/off switch 18, and memory 20. The sensing element 13 is arranged to 
measure information present on the encoded physical medium 30. When the 
utilized encoding scheme implements a marker 34, the decoder 14 is arranged to 
determine whether the marker 34 is present in measured mformation, and when 
the marker 34 is sensed, to decode the measured information. The transceiver 
16 IS operable to transmit data such as decoded information to the computer 
system 40. Depending upon the embodiment, the transceiver 16 may establish 
either a uni-directional or bi-directional communications link 22 between the 
interface 10 and the computer system 40. The communications link 22 is 
preferably a wireless communications link such as one based upon infrared (IR), 
radio-frequency (RF), or ultrasonic communications technology. However the 
communications link 22 may take the form of a wired communications 'link 
such as a serial RS-232 or RS-485 data cable, or a parallel data cable. 

In some embodiments, the sensor 12 operates by measuring information 
selected from the encoded physical medium 30 by the user, decoding as 
necessary, and then transmitting the decoded information to the computer 
system 40 for fiirther processing. In other embodiments, the sensor 12 includes 
further hardware^^forprocessin&:thefmeasuredTinfonnati locally. Fofisxample, 
the sensor 12 may include a microcontroller such as a PIC microcontroller 
programmed to process the measured information. The decoder 14 may be part 
of the microcontroller, or may be separate circuitry. In some embodiments, the 
sensor 12 maintains in the memory 20 a database related to the measured 
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information. The infonnation stored in the database may be used locally at the 
sensor and/or saved for subsequent transmission. 

The computer system 40 appears in Figure 1 as a personal desktop 
computer. However, it is contemplated that the interface 10 is suitable for use 
with a wide scope of electronic devices. The wide scope of suitable computer 
systems encompasses all types of personal computers, interactive TV systems, 
set-top boxes, web interfaces, haptic interfaces, streaming music and video 
sciui;ces, and many others. One particular example is a WebTV "net-top box." 
Further, although^^the interface>^^W^^ representative of and thus 

generic to a broad range of interfaces contemplated by the present invention, it 
will be appreciated that computer interfaces of the present invention may take 
many forms which go beyond the example interface 10 of Figure 1 . 

With reference to Figure 2, a method 100 for providing an interface 
between a user and a computer system in accordance with one aspect of the 
present invention will now be described. An initial step 102 provides the user 
with an encoded physical medium 30 and a sensor 12 suitable for sensing 
information present within the encoded physical medium 30. As described 
above, the encoded physical medium 30 may take any suitable form. One 
suijable method for performing the step 102 is described in more detail below 
with reference to Figure 3. 

In a next step 104, the user explores the encoded physical medium 30 and 
selects a desired portion 32 of the encoded physical medium 30. The user may 
be drawn into the desired portion 32 through text, coloring, or graphics 
illustrated on the desired portion 32. The text, coloring or graphics illustrated 
on the desired portion 32 may represent the encoded information, may be in 
addition to the encoded information, or may be some suitable combination of 
illustration and encoded information. Instead of being drawn in, perfiaps in the 
case of a game or work task, the user may be selecting the desired portion 32 
based upon some predefined criteria. For example, the user may be searching 
for a clue to:a^:pu2zle;game;^;or sinq)ly:doing inventory and selecting a bar code 
found on a product during this process. In any event, once the user has selected 
the desired portion 32 in step 104, in a step 106 the user engages the sensor 12 
with the desired portion 32 of the encoded physical medium 30. The sensor 
engagement of step 106 will typically involve the user setting the sensor 12 to 
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an ON state that indicates that the sensor 12 should be in operation. In the case 
of the interface 10 of Figure 1, the step 106 would involve operation of the 
on/off switch 18, Depending upon the particular sensor and the application 
sensor engagement may require the user to bring the sensor 12 into close 
proximity to or in contact with the desired region 32. 

In a next step 108, the sensor 12 measures information presem within the 
desired region 32 of the encoded physical medium 30. Information is defined 
herem as any data that the sensor 12 is capable of measuring TTius the 
mfonnation measured? by^theisensor. 12 i^^^^ to information that has 

been purposefully encoded into the desir^ region 32 of the encoded physical 
medium 30. 

A step HO then determines whether the measured information has null 
meaning. When step 110 determines that the measured information has null 
meaning, it is simply determining that the measured information has not been 
marked, for the present purposes, as containing encoded in&rma&Gn. However 
as will be appreciated, a deteimination of null meaning may be consequential' 
Accordingly, when step 110 deteimines that the measured information has null 
meaning, a step 112 performs any action indicated by such a determination. For 
example, the sensor 12 may be equipped with a light that blinks or a buzzer that 
sounds when the measured inforaiation has null meaning. As another example 
the sensor 12 may have memory 20 that is utilized to keep track of the meaning 
of the diflFerent measured regions, including each null determination 
Alternatively, the nuU information may be transmitted to the computer system 
40. In any event, once step 1 12 is complete, the control of the method 100 is 
passed back to step 104 allowing the user to explore further and select another 
region 32 for sensing. 

When it is determined in step 1 1 0 that the information measured in step 
108 does not have nuU meaning (e.g., the measured information has been 
marked as containing : encoded infonBation), ra»arat is-passe* to a step 114 
wherein the sensor 12 interprets the measured information. Depending upon the 
specific appUcation, step 1 14 may mvolve just decoding of the information fiom 
the particular encoding scheme into a data format suitable for transmission by 
the transceiver 16. However, in some embodiments significant processing of 
the measured information will occur locally at the sensor 12. Thus in a next 
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Step 116, the sensor 12 performs an operation that is a function of both the 
information interpreted in the step 1 14 and the context in which the information 
was measured. Note that context depends upon the particular application and 
may include the nature of previously interpreted information, the timing of the 
5 user's engagement of the sensor 12, information received at the sensor from the 
computer system 40, etc. 

For example, with each new engagement of the sensor 12, the sensor 12 
may store the interpreted information in a database in the memory 20 and then 
evaluate the database or a portion of it to determine whether a predefined 

1 0 condition has beeinLtsatisficd^A;ipr€Kiefinedi:condition could be the user gathering 
a set number of clues or data points, at which point the sensor transmits all or 
some of the stored information to the computer system 40. In one specific 
example, the user may be perusing an encoded catalog magazine 30 with a 
hand-held wand sensor 12. As the user engages the wand sensor 12 with 

15 regions of the catalog 30 representing desired products, these regions are sensed 
and~the-iiifonnalion therein interpreted by the wand sensor 12. When finished, 
the user may select an order region 32 indicating to the sensor that the user is 
ready to order and purchase the selected items. At this point, the 
communication link 22 could be established with the computer system 40, 

20 which may be local or remote, and the user's order information could be 
transmitted to the computer system 40 which in turn could process the order or 
further transmit the order as necessary. 

In other embodiments, the indicated action of step 116 includes the 
computer system 40 and/or the sensor 12 responding to the measured 
25 information by providing fcedbacL The feedback could take any suitable form 
such as audio, visual or tactile feedback. In any event, once the indicated action 
has been performed in the step 116, the control of the method 100 is passed 
back to step 104 allowing the user to further explore the encoded physical 
medium 30 and select otiier regions for sensing. 

30 As noted ^above with : reference; to Figure 1, certain encoded physical 

mediums 30 include a document ID hot spot 33. In these embodiments, when a 
user first begins exploring the encoded physical medium 30 as described in step 
104, the initial step 106 ought to be the engagement of die sensor 12 with the 
document ED hot spot 33. Then in steps 1 14-1 16, die sensor 12 coidd store the 



- 13- 



wo 99/18487 



PCT/US98/20661 



document ID for later use. or immediately transmit it to the computer system or 
both; It depends upon the specific application. For example, it is contemplated 
Uiat the sensor 12 store the document ID and include it with content decoded 
h-om each subsequently measured region prior to fimher processing of the 
5 decoded content. 

Further, certain encoding schemes may not require the use of a marker 
Withm these schemes, steps 110 and 112 of Figure 2 would become 
unnecessaiy.. and thus another method for providing an interface using an 
encodmg scheme.without*a.marker.^co«ld^^^^^^^ by simply skifiing 

10 directly from step 108 to step 114 of Figure 2. 

Turning next to Figure 3. a method 102 for providing a user an encoded 
physical medium 30 in accordance with another aspect of the present invention 
will be described In a first step 200, the designer creates a representation of a 
physical medium 30 that will include hot spots. A "hot spot" is defined as a 

15 particular region wherein content is encoded, and may include text and/or 
graphics. The encoded content of the hot spot can take any of a variety of 
forms, dependent upon such things as the encoding scheme and the goals of the 
designer. For example, the encoding scheme may be such that the encoded 
content visually blends together With any text and graphics generated by the 

20 designer. Altematively, the encoding scheme may result in the encoded content 
being visually distinctive or completely hidden from the viewer. The 
representation of the physical medium 30 may be created within an off-the-shelf 
or custom made design software system, or the representation may be a physical 
model. In a step 202, the designer defines the content of the hot spots 

25 Alternatively, the designer may be provided with the content. The content of a 
hot spot IS the information to be encoded therein, and may include computer 
mstmctions, a uniform resource locator (URL), and other data. 

In a subsequent step 204, the content of each hot spot is encoded 
according to a particular encoding scheme. Preferably, the enj^ding wfll be 
automated such that the designer will simply enter the desired content and 
mitiate the encoding process, which is in mm perform.ed by a computer system 
or some other suitably programmed tool. In some embodiments, the encoding 
process will also introduce a marker into the encoded content indicating that 
certain mfonnation is encoded in the hot spots. Once the content is encoded in 



30 
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a Step 206 the encoded content is inserted into the appropriate locations within 
the representation of the physical medium 30. In a step 208, the encoded 
physical medium 30 is generated from its representation. For example, when 
the representation is created by a system such as graphic design software and 
the encoding scheme is a spectral encoding scheme, a printer utilizing the 
necessary inks can print out the encoded physical medium 30. 

With reference to Figures 4-6, a first spectral encoding scheme according 
^ to another embodiment of the present invention will be described. The first 
spectral encoding^/scheme^represents^contenti^^ three different values encoded 
within a hot spot 220. The sensor "decodes" these values by measuring the 
intensities of three different encoding colors CI, C2, and C3 found within the 
hot spot 220. CI, C2, and C3 may, for example, correspond to red, green, and 
blue (RGB). Alternatively, CI, C2, and C3 may be selected from outside the 
visible light range (e.g., infixed colors) or may be a combination of visible and 
invisible colors. 

As will be apparent to those skilled in the art, the hot spot 220 itself can 
be created using inks whose colors do not correspond directly to CI, C2, and 
C3. Take the instance where CI, C2, and C3 correspond to RGB. Most likely, 
. the color printing system selected to produce the hot spot 220 will be a 
"CMYK" type using cyan (C), magenta (M), yellow (Y), and black (K) inks to 
produce color images. In such a case, the encoded medium designer may be 
provided a mapping between CMYK space and the different content values, 
even though the sensor will be determining each content value by measuring the 
intensities of the three different encoding colors RGB within the hot spot 220. 

Figure 4 represents diagramattically a hot spot 220 encoded according to 
the first spectral encoding scheme. A pie chart 222 indicates that the different 
encoding colors CI, C2, and C3 are measurable in the hot spot 220, each taking 
on their own particular intensity. Thus the engaged sensor would measure three 
d iff erent values, one each for CI, C2, and C3. These values taken together 
provide the encoded content Figure 4 does not illustrate the visual appearance 
a hot spot would likely take on, but merely represents that the different 
encoding colors are measurable within the hot spot 220. Of course, depending 
upon the content encoded therein, each hot spot will have varying intensity 
levels and in some instances the intensity level of certain encoding colors would 
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be zero The actual visual appearance of the hot spot 220 would include any 
text and/or graphical illustrations that the designer has created. 

Figure 5 illustrates a sensor 300 responsive to the first spectral encoding 
scheme and thus operable to measure information from an encoded physicd 
5 medium 30. The sensor 300 includes a light emitter 302. a sensing element 304 

Lt,Dl LED2, and LED3, each operable to emit light corresponding to CI C2 
and C3, respectively. The sensing element 304 is a broadband sensing elemem 
responsive tostha.entire.:light.spectrum:?^ the sensor 300 with a 

10 desired region 32 of the encoded physical medium 30 by turning the sensor 300 
on and^bnngmg the light emitter 302 and the sensing element 304 into 
reasonably close proximity to the desired region 32. When the sensor 300 is 
properly engaged with the desired region 32, the shroud 306 helps prevent the 

15 I^Sugr''' ^""^ ineasuring extraneous information in the form of 

With reference to Figure 6. one suitable method 108 for measuring the 
mfonnation stored within the desired region 32 will now be described Simply 
put, the method 108 of Figure 6 sequences through measuring the intensities of 
the encoding colors CI. C2, and C3. In a first step 320. the user engages the 
sensor 300 with the desired region 32. A step 322 turns LEDl on. me^L the 
refiected intensity of CI. and then tums LEDl off. A step 324 turns LED2 on 
measures the reflected intensity of C2. and then tums LED2 off. A step 326 
tons LED3 on. measures the reflected intensity of C3, and then tums LED3 off 
Typically the sensing element 304 will generate an analog voltage proportional 
to the light mtensity and the sensor 300 will include an analog-to-digital (A/D) 
wn verter Thus the number of content identification numbers available with the 
nrst encodmg scheme is directiy dependent upon the precision of the A/D 
converts. 

With reference to Figures 7-8 a second spectral encoding, scheme 
a-u,rdmg .o yet another embodiment of the present invention will be described 
me second^ectral encoding scheme represents content via six differem values 
encoded witfiin a hot spot 250. The sensor "decodes" these values by 
measurmg the intensities of six different encoding colors. The second spectral 
encodmg scheme also utilizes another infrared color IR4 to serve as a marker 
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indicating that content has been encoded in the hot spots. Preferably, IR4 will 
be selected from among those infrared colors that do not very often arise 
naturally, thus decreasing the possibility of a false mark indication. 

Figure 7 represents diagramattically the hot spot representation 250 as it 
might be stored in a computer representation. A pie chart 252 indicates that the 
different colors red, blue, green, IRl, IR2, and IR3 are present in different 
proportions throughout the hot spot representation 250. The color IR4 is 
appUed across the hot spot representation 250 thus marking the entire hot spot 
representation 250; :KMteniativelyi:; t^^ could be applied just in a 

portion of the hot spot representation 250. 

Figure 8 diagramattically represents a hot spot 260 as applied to an 
encoded physical medium according to one embodiment of the present 
invention. As noted above, many color printing systems are "CMYK" type 
which use cyan (C), magenta (M), yellow (Y), and black (K) inks to produce 
color images. Figure 5 sinqily illustrates- that axolor encoding scheme may be 
based upon the measurable intensities of certain colors such as RGB, yet the hot 
spots may be printed or created using another system such as the conunon 
CMYK color printing technique. 

With reference to Figure 9, one suitable method for performing step 204 
of Figure 3 in accordance with a spectral encoding scheme will now be 
described. As will be appreciated, the number of encoding colors and the 
sensitivity of the spectral encoding scheme to the encoding colors' intensities 
will determine the quantity of binary numbers available to represent content. 
The standard creator may choose any number of content identities less than or 
equal to that available with the sensor 300. In any event, each binary number 
(essentially a content identification number) is assigned a specific meaning or 
content. Then for each hot spot having content defined by step 202 of Figure 3, 
in a step 310 a binary nxunber representing the desired content of the hot spot is 
^trnKTs^ tP^^f^rAiu^M^ ii^^^ aggignTnmt In a uext stcp 3 12, the binary 

number correspbiiding^to the jdesired c^ present hot spot is encoded 

according to the color code of the spectral encoding scheme. In some 
embodiments, the IR4 marker is also inserted at this point However, in other 
embodiments the IR4 marker is only inserted upon generation of the encoded 
physical medium 30. 
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Turning next to Figure 10, a data linked book 350 in accordance with one 
embodiment of the present invention will now be described. A primary purpose 
of the Imked book 350 is to link a physical book with data such as video and 
audio streams available via an information network such as the Internet The 
linked data is then presented displayed, played, etc.) on an Internet device 
such as a WebTV or a personal computer. 

The linked book 350 includes a physical book 352. a sensor 353 having 
an infrared transmitter 354. a plurality of pages such as page 356 and a plurality 
of hot spots ;su(ih^asrchotrrspots^358; 360. and^362. The physical book 352 
appears conventional to a viewer in that the book 352 flips open to the difFerem 
pages, each of which provide meaningful information in the form of text and 
graphics. In the example of Figme 10. the physical book 352 is opened to the 
page 356 entitled " Weather Report." Thus the user should immediately realize 
that the Weather Report page 356 is electronically linked to weather report 
mformation available over the con-esponding information network hi the 
embodmiem of Figure 10. each of the hot spots represents a unifonn resource 
locator (URL). As will be appreciated, a URL is the addressing mechanism 
used by the Internet to correspond to a unique Internet address. A URL 
together with any other desired information, is encoded within each hot spot 
according to a selected encoding scheme such as a spectral encoding or bar code 
scheme. 



When the user engages the sensor 353 with a desired hot spot, the sensor 
353 decodes the content of the hot spot, performs any necessary interpretation 
and other local fimctions. and then transmits the URL to the computer system 
25 370. The computer system 370 then uses the URL and other received 
information to download the desired data from the Intemet, presenting such data 
to the user m the proper form. For example, a video stream may be displayed 
on the computer screen of the computer system 370. 

Turning next to Figure H . a data linked globe 400 in accordance with yet 
30 another embodiment of the present- invention will now be described. The data 
Imked globe 400 includes both a sensor 402 having an infrared transmitter 404 
and a plurality of hot spots 406. The data linked globe 400 of Figure 11 
presents a spherical earth map. Encoded within the hot spots 406 are linking 
data. The linking data of Figure 1 1 may take any of a variety of suitable forms. 
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For example, similar to the data linked book of Figxire 1 1 , the linking data may 
include a URL. Each hot spot may represent a town, region, province, coxmtry, 
etc. The associated URL may direct the computer system 420 to an Internet 
World Wide Web page produced, e.g,, by the Chamber of Commerce for that 
5 town, region, etc. 

In an alternative embodiment, the computer system 420 of Figure 1 1 
maintains a database of geographical and/or historical data regarding the region 
represented by the hot spot. The linking data would then instruct the computer 
system 420 to present the corresponding information through the appropriate 
10 media interfecc^; &;f;V audio and video?; to embodiment, the linking 

data stored in each hot spot would contain the bulk of the content, the sensor 
402 simply transferring this content to the computer system 420 which would in 
turn present this information through the appropriate media interface. 

While this invention has been described in terms of several preferred 
15 embodiments and a number of specific examples, there are alterations, 
permutations, and equivalents which fall within the scope of this invention. 

For example, it is contemplated that in certain embodiments encoded 
content will be inserted onto a plurality of detachable bodies. A user provided 
with these may attach the bodies to a variety of different physical media. In this 
20 mariner, the user is, in essence, able to configure and program his own computer 
interface. As will be appreciated, the attachment mechanism of the detachable 
bodies may take any suitable form such as magnetic stripping, tape, hook-and- 
pile (eg. Velcro®) members, etc. 

In another suitable embodiment, the marker 34 is a template that is 
25 positioned upon the encoded physical medium 30. The template may be 
corifigurable such that the user can select the region 32. Alternatively, the 
template may affix to the encoded physical medium such that the region 32 is 
defined by the predetermined mating of the template and the encoded physical 
medium 30. 

30 As will be appreciated, the variety of physical medium upon which 

content may be encoded according to the present invention is almost limitless, 
ranging firom toys to tools to industrial parts and beyond. Still fiirther, the hot 
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spots may be encoded regions displayed upon a computer monitor, television 
screen, or the like. 

Likewise, the nature of content that may be encoded in the hot spots is 
unconstramed. The content may be abstract or concrete. A concrete example 

5 anses m the case of industrial parts where the encoding could be both machine 
and human readable and geared towards assisting in an automated training 
system. Under the training system, the worker checks the code on the part to 
determme the correct assembly order or obtain other information about the part 
Thus, with tiainingrthe worker. W the sensor only when she 

1 0 encounters a code that she is unfamiliar with. 

It is further contemplated that the sensor may take many different forms 
For example, rather than a wand or portable sensing device, the sensor may be a 
stauonary device where the encoded object is passed under or near the 
stationary sensor in order to cause engagement. 



15 



In another aspect related to the method of Figure 3, a user is provided a 
software utility for creating her owp encoded physical embodiments. This 
allows multiple users to create and exchange their own encoded physical 
mediums. Hie user could also personalize her stationary wth encoded 
information, encode information onto her business cards, or mark her 
20 belongings for security purposes. 

The above description of the first spectral encoding scheme of Figures 4- 
6 was based upon the assumption that the hot spots were generated utilizing 
reflective inks. Thus the hot spots generated Ught that corresponded to the 
encoded content simply by reflecting light emitted by the LEDs. However in 
25 oAer embodiments the inks used to create the hot spots may 'be 
phospholummescem. or the hot spots could be created with some altemative 
mechamsm such as LEDs in order to emit the necessary hght In eiflier case, the 
sensor 300 can be designed without a light emitter 302. 

•n, encoding scheme involves the use of gray-scale coding 

Tliat is content can be encoded within hot spots using diflferem densities of 
black. In this embodiment, standard black and white printing techniques are 
sufficient for creating the encoded medium. 
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It is also contemplated that the sensor 300 of Figure 5 may be suitably 
designed without a shroud 306. In some embodiments, the spectral encoding 
scheme tends to be insensitive to ambient light and thus the shroud 306 would 
be unnecessary. Additionally, the shroud 306 is removable by the user. In other 
embodiments, ambient light filter circuitry (or software) is included in the 
sensor 300 rendering the shroud 306 imnecessary. Still other embodiments of 
the sensor 300 include both the shroud 306 and filter circuitry. Those of skill in 
the art will well imderstand the design of shrouds and filter circxiitry. 

Therefore it is desired that the appended claims be interpreted as 
including all such alterations, permutations, and equivalents as fall within the 
tme spirit and scope of the present invention. 
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fVhat is claimed is: 



CLAIMS 

1. A method for interfacing a user and a computer system using an 
encoded physical medium, the encoded physical medium suitable for having at 
least one region wherein information has been encoded, the method comprising 
the steps of: 

a) measuring information present in a first region of the encoded 
physical medium; and 

b) determining whether the measured information present in the first 
region includes a marker indicating that certain information has been encoded in 
the first region. 



2. A method as recited in claim 1 wherein the step of measuring 
information present in a first region of the encoded physical medium includes 
the step of engaging a sensor with the first region of the encoded physical 
medium, the engaged sensor operable for measuring information present on the 
encoded physical medium. 



3. A method as recited in claim 2 wherein tiie sensor has an on and an 
off state and the step of engaging the sensor with the first region of the encoded 
physical medium includes the step of receiving a command requesting that tiie 
sensor be turned on. 



4. A method as recited in claim 2 wherem the marker is operable to 
generate light fi-om within a particular range of electromagnetic wavelengths 
and the sensor includes a sensing element responsive to the particular range of 
electromagnetic wavelengths, the step of engaging the sensor with die first 
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region of the encoded physical medium including positioning the receiver 
within the proximity of the first region. 



5. A method as recited in claim 4 wherein the sensor further includes 
a light emitter operable to emit light within the particular range of 
electromagnetic wavelengths. 



6. A method as recited in claim 5 wherein the operability of the 
marker to generate light from within the particular range includes the ability to 
reflect light from within the particular range. 



7. A method as recited in claim 4 wherein the operability of the 
marker to generate light from within the particular range includes the ability to 
emit light from within the particular range. 



8. A method as recited in claim 4 wherein the step of detemiining 
whether the measured information present in the first region includes the marker 
includes the steps of: 

sensing light generated from the first region; 

determining whether the ligjit generated from the first region includes 
light fipom within the particular range, light from within the particular range 
indicating that the measured information present in the first region does include 
the marker and thus the certain encoded information. 



9. A method as recited in claim 8 wherein when it is determined that 
the first region does include the marker, the method fiuther includes the step of 
decoding the certain information into certain decoded information suitable for 
use by the computer system. 
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10. A method as recited in claim 9 wherein the certain encoded 
mformation has been encoded according to a spectral encoding scheme, the 
receiver further responsive the spectral encoding scheme, and the step of 
engaging the sensor with the first region of the encoded physical medium 
includes positioning the sensor within the proximity of the firet region. 



11. A method as recited in claim 10 wherein the spectral effcoaing 
scheme includes light outsideithlgl^liljlMight^speefflffli. 

10 

12.. A method as recited in claim 11 wherein the spectral encoding 
scheme includes infrared light. 



13. A method as recited in claim 10 further including the step of 
decoding the certain information encoded according to the spectral encoding 
scheme into certain decoded information suitable for use by the computer 
system. 



14 A method as recited in claim 9 wherein the certain encoded 
infonnation includes information encoded accordmg to a bar code scheme, the 
receiver further responsive to the bar code scheme, and the step of engaging the 
sensor with the first region of the encoded physical medium includes 
positioning the sensor within the proximity of the first region. 



15. A method as recited in claim 1 wherein when it is determined that 
the measured information present in the first region includes certain encoded 
information, the method fimher includes the step of decoding the certain 
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encoded information into certain decoded information including a function to be 
performed by the computer system. 



16. A method as recited in claim 13 wherein the function to be 
performed by the computer system includes providing feedback to the user of 
the computer system. 



17. A method as recited in claim 16 wherein the feedback is generated 
inunediately and locally by the computer system. 



18. A method as recited in claim 16 wherein the feedback provided to 
the user includes audio feedback. 



19. A method as recited in claim 16 wherein the feedback provided to 
the user includes visual feedback. 



20. A method as recited in claim 13 wherein the computer system is a 
local computer system and the function to be performed by the local computer 
system includes transmitting a control instruction to a remote computer system. 



21. A method as recited in claim 20 wherein the transmitted control 
instruction includes a uniform resource locator (URL). 



22. A method as recited in claim 21 wherein the coniputer system 
includes a display screen, the URL represents a particular web page available on 
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the World Wide Web, and the method further includes the step of displaying the 
particular web page on the display screen. 



23. A method as recited in claim 1 wherein when it is determined that 
5 the measured infonnation present in the first region includes certain encoded 
information, the metiiod fiirther includes the steps of: 

c) decoding;: A& .certain;vencoded ;infonn^^ into certain decoded 
information; and 



10 



15 



d) storing the certain decoded information. 



24. A method as recited in claim 23 wherein when it is determined that 
the measured information present in the first region does not include certain 
encoded information, the method further includes the step of e) storing a value 
mdicating that the first region does not include certain encoded information. 



25. A method as recited in claim 24 further including the step of f) 
repeatedly performing steps a) - e) until a specific condition is satisfied. 



26. A method as recited in claim 25 wherein the specific condition is 
satisfied when the user requests a desired operation be performed and the 
desired operation is a function of at least some of the stored information, the 
method finther including the steps of: 

g) receiving a request that the desired operation be performed; and 

h) performing the desired operation. 
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27. A method as recited in claim 25 wherein satisfaction of the specific 
condition depends upon the stored information, the method further including the 
steps of: 

g) determining that the stored information is such that the specific 
5 condition is satisfied; and 

h) in response to the satisfaction of the specific condition, performing 
an operation that is a fimction of at least some of the stored data. 



28, A method as recited in claim 1 wherein the encoded physical 
10 medium includes at least one page having text and graphics. 



29. A method as recited in claim 1 wherein the encoded physical 
medium includes a spherical object. 



15 30. A method as recited in claim 1 wherein the encoded physical 

medium includes an article of apparel. 



31. A method as recited in claim 1 wherein the encoded physical 
medium includes packaging material. 

20 

32. A method as recited in claim 1 wherein the encoded physical 
medium is selected by the user firom local surroundings. 



33. A method as recited in claim 1 wherein the at least one region 
25 provides a visual indication to the user that information has been encoded 
therein. 
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34. A method as recited in claim 33 wherein the indication to the user 
that infonnation has been encoded widiin the at least one region provides a clue 
as to the nature of the infonnation encoded therein. 



35. A method as recited in claim 1 6 wherein the feedback provided to 
the user mcludes tactile feedback. 
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36. A method for generating an encoded physical medium having a 
region wherein content has been encoded, the method comprising the steps of: 

receiving content that is to be encoded into a desired location on the 
encoded physical medium; 

encoding the content according Xo a particular encoding scheme suitable 
for application onto the encoded physical medium; and 

inserting the encoded content and a M^ker into a corresponding desired 
location within a representation of the encoded physical mgdium, the marker 
indicating that the content h^^^^^^mmk^oortespon^ig^^B^ 



37. A method for generating an encoded physical medium as recited in 
daim 36 further including the step of generating the encoded physical medium 
from the representation of the corresponding physical medium. 



38. A:inethQdvfor=^aatingian^encoded physical medium as 
claun 36 wherein the representation of the encoded physical medium is stored in 
25 a computer readable medium. 
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39. A method for generating an encoded physical medium as recited in 
claim 36, the step of encoding the content together with the marker including 
the steps of: 

generating a binary number that represents the content; and 

5 encoding the binary number that represents the content according to a 

spectral encoding scheme. 



40, A method for generating an encoded physical medium as recited in 
claim 39 wherein the marker represents ink that reflects light from within a 
10 particularrange of electromagnetic wavelengths. 



41, A method for generating an encoded physical medium as recited in 
claim 36 further including the step of designing text and graphics within the 
representation of the encoded physical, medium. 

15 

42, A method for generating an encoded physical mediimi having a 
region wherein content has been encoded, the method comprising the steps of: 

receiving content that is to be encoded into a desired location on the 
encoded physical medium; 

20 encoding the content according to a particular encoding scheme suitable 

for application onto the encoded physical medium; and 

inserting the encoded content and a marker into the desired location of the 
encoded physical medium, the marker indicating that the content is encoded 
within the desired location, 

25 

43, A computer interface for interfacing a user and a computer system 
using an encoded physical mediimi, the encoded physical medium suitable for 
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having at least one region wherein information has been encoded, the computer 
mterface comprising: 

a sensor operable for ineasuring information present on the encoded 
physical medium; and 

a first device coupled to the sensor and responsive to detennine whether 
infonnation measured by the sensor includes a marker indicating that certain 
encoded information is present in the measured infonnation. 



44. A computer interface as recited in claim 43 further comprising a 
second device responsive to the first device such that when the first device 
determines the presence of the marker, the second device is operable to decode 
the certain encoded information present in the measured infonnation. 



45. A computer interface as recited in claim 44 further comprising a 
transmitter device operable to transmit the certain decoded infonnation to the 
computer system. 



46. A computer interface as recited in claim 44 fiirther comprising: 

a third device operable to process the certain decoded infonnation and 
20 generate fonnatted data suitable for transmission to the computer system; and 

a transmitter device operable to transmit the fonnatted data to the 
computer system. 



47 A computer interface as recited in claim 43 fimher comprising a 
memory device suitable for storing the certain encoded infonnation. 



-30- 



wo 99a&487 



PCTAJS98/20661 



48. A computer interface as recited in claim 43 further including a 
feedback device operable to provide feedback to the user in response to the first 
device. 



5 49. A computer interface as recited in claim 48 wherein when the first 

device determines that the measured information does not have the marker, the 
feedback device is operable to provide feedback to the user indicating that the 
measxired information doesNnotincluderencodedjnformation. 



10 50, A computer interface as recited in claim 43 wherein the marker is 

operable to generate light firom within a particular range of electromagnetic 
wavelengths, the sensor including a sensing element responsive to the particular 
range of electromagnetic wavelengths. 



15 5 1. A computer interface as recited in claim 50 wherein the operability 

of the marker to generate light firom within the particular range includes the 
ability to reflect light fi-om within the particular range, the sensor fiirther 
including a light emitter operable to emit light within the particular range. 



20 52. A computer interface as recited in claim 50 wherein the sensor 

further includes a shroud arranged to protect the sensing element fi'om ambient 
light when the sensor is properly engaged with the encoded physical medium. 



53. A computer interface as recited in claim 50 wherein the sensor 
25 further includes ^filter circuitry operable to filter out noise within the measured 
information due to ambient light. 
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54. An encoded physical medium suitable for use in interfacing a user 
and a computer system, the encoded physical medium including a region 
wherem certain information is encoded, the certain encoded information 
including a marker indicating that the certain encoded information is encoded in 
the first region, the certain encoded information including data suitable for 
interpreting into computer readable data. 

55. 4n:i«ncoded :physiGal,.TOedium as. recited in claim 54 wherein the 
marker ,s operable to generate light from within a particular range of 

10 electromagnetic wavelengths. 



56. An encoded physical medium as recited in claim 55 wherein the 
marker is operable to generate infrared light. 



15 



20 



25 



57. An encoded physical medium as recited in claim 55 wherein the 
data suitable for decoding into computer readable data is encoded according to a 
spectral encoding scheme. 



58. An encoded physical medium as recited in claim 55 wherein the 
data suitable for decoding into computer readable data is encoded according to 
bar code scheme. ^ 



59. An encoded physical medium as recited in claim 54 .wherein the 
data suitable for decoding into computer readable data includes text^pcesented 
upon the encoded^physical medium and the marker is ink applied over the 
selected text uic 
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60. An encoded physical medium as recited in claim 59 wherein the 
ink applied over the selected text reflects light outside of the visible light 
spectrum. 



5 61. An encoded physical medium as recited in claim 54 wherein the 

encoded physical medium consists of an article of apparel. 



62. An encoded physical medium as recited in claim 54 wherein the 
encoded physical medium consists of packaging material. 

10 

63, An encoded physical medium as recited in claim 54 wherein the 
encoded physical medium consists of a book. 



64. An encoded physical medium as recited in claim 54 wherein the 
1 5 encoded physical medium consists of a magazine. 



65, An encoded physical medium as recited in claim 54 wherein the 
certain encoded information is encoded according to a spectral encoding 
scheme, the spectral encoding scheme including encoding colors red, green, and 
20 blue. 



66. An encoded physical medium as recited in claim 65 wherein the 
spectral-eneoding scheme arcodes information based upon the intensities of the 
encoding colors red,: grcenvand blue, 

25 
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67. An encoded physical medium as recited in claim 65 wherein the 
spectral encoding scheme further includes at least one encoding color selected 
from the infrared range. 



68. An encoded physical medium as recited in claim 66 wherein the 
inks utihzed to print the encoding colors are cyan, magenta, yellow, and black. 



69. An encoded physical medium as recited in claim 66 wh,erein the 
inks utilized to print the encoding colors are phospholuminescent. 



70. An electronic data linked physical medium suitable for linking a 
physical medium with video and audio data stored on multimedia networked 
computers, the electronic data linked medium comprising: 

a physical medium having at least one hot spot encoded with linking data 
15 enabling the electronic data linked physical medium to access remote data; 

a sensor operable to measure and decode the linking data; and 

a transmitter operable to transmit the linking data to a remote computer 
system, the remote computer system responsive to the linking data to retrieve 
the remote data and present it to a user of the electronic data linked physical 
20 medium, 

whereby the user of the electronic data linked physical medium is 
provided a mechanism for linking to and accessing remote data. 



71. An electronic data linked physical medium as recited in claim 70 
wherein the physical medium is a linked book. 
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72. An electronic data linked physical medium as recited in claim 70 
wherein the linking data is encod|j^c^f^^|^gi^a!^^ scheme 



presence of the marker. 



73, An electronic data linked physical medium as recited in claim 70 
wherein the remote computer system is a personal computer coupled to the 
Internet, and thc^linking data^iincludes a uniform resource locator (URL). 



74. An electronic data linked physical medium as recited in claim 70 
wherein the remote computer is a WebTV coupled to the Internet, and the 
linking data includes a uniform resource locator (URL), 



75. An electronic data linked physical medium as recited in claim 70 
wherein the hot spots are removably attached to the electronic data linked 
physical medium. 



76. A system comprising a plurality of electronic data linked physical 
mediums as recited in claim 75, the hot spots suitable for removably attaching 
to each of the electronic data linked physical medituns, wherein the user is 
capable of creating a variety of different configurations for the system. 



77. An electronic data linked physical medium as recited in claim 70 
wherein the physical;^medium is a globe-shaped map. 



78. An electronic data linked physical medium as recited in claim 77 
wherein the remote data retrieved via the at least one hot spot is historical data 
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corresponding to the region of the globe-shaped map over which the at least one 
hot spot lies 



79. An electronic data linked physical medium as recited in claim 77 
wherein the remote data retrieved via the at least one hot spot is geographical 
data corresponding to the region of the globe-shaped map over which the at 
least one hot spot lies. 



80. An electronic data linked physical medium as recited in claim 77 
wherein the remote data retrieved via the at least one hot spot is a URL 
corresponding to a web page for the region of the globe-shaped map over which 
the at least one hot spot lies. 



81. An electronic data linked physical medium as recited in claim 70 
15 wherein the physical medium is an item of apparel. 



82. An electronic data linked physical medium as recited in claim 81 
wherein the at least one hot spot is disposed on the item of apparel such that the 
at least one hot spot coincides with a predefined portion of a wearers anatomy, 
20 the remote data retrieved via the at least one hot spot being anatomical data 
related to the predefined portion of anatomy. 



83. An electronic data linked physical medium as recited, in claim 70 
wherein the at least one hot spot takes the form of a tattoo on the user. 



84. An electronic data linked physical medium as recited in claim 83 
wherein the content encoded in the at least one hot spot is related to the user. 
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85. An electronic data linked physical medium as recited in claim 84 
wherein the content encoded in the at least one hot spot is a URL of a home web 
page of the user. 
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PROVIDE USER WITH AN ENCODED 
PHYSICAL MEDIUM AND A SENSOR SUITABLE 
FOR SENSING INFORMATION PRESENT ON 
THE ENCODED PHYSICAL MEDIUM 
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USER EXPLORES THE ENCODED PHYSICAL 
MEDIUM AND SELECTS A DESIRED REGION 
OF THE ENCODED PHYSICAL MEDIUM 
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DESIGNER CREATES REPRESENTATION OB. 
PHYSICAL MEDIUM THAT WILL INCLUDE "HOT 
SPOTS" AND MAY INCLUDE TEXT AND/OR 
GRAPHICS 
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ENGAGE SENSOR WITH HOT SPOT 
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REPRESENTS THE CONTENT OF THE 
PRESENT HOT SPOT 
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